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DESCRIPTION 
Image visualization 

The present invention relates to the field of visualizing a three-dimensional data set in 
the field of digital imaging and in particular in the field of medical digital imaging. In 
5 particular, the present invention relates to a method of interactively visualizing a three- 
dimensional data set of an object of interest, to a data processing device, to a scanner 
system and to a computer program for performing an interactive visualization of a 
three-dimensional data set 

10 Most medical imaging modalities generate increasingly more and more large three-di- 
mensional data sets, giving rise to a demand for fast and high quality rendering meth- 
ods. 

Volume rendering is a technique for visualizing sampled fimctions of three spatial dimen- 
15 sions by computing 2D projections of a semi-transparent volume. Volume rendering pro- 
jects a volume dataset onto a two-dimensional (2D) image plane or frame bxifFer. Volume 
rendering can be used to view and analyze three-dimensional (3D) data from various disci- 
plines, such as biomedicine, geophysics, computational fluid dynamics, finite element 
models and computerized chemistry. Volume rendering is also useful in the application of 
20 3D graphics, such as virtual reality (VR), computer aided design (CAD), computer games, 
computer graphics, special effects and the like. The various applications, however, may use 
a variety of terms, such as 3D datasets, 3D images, volume images, stacks of 2D images and 
the like, to describe volume datasets. 

25 Because of the increasing size of images, for example, in the medical domain, an interactive 
rendering speed at a high display quality continues to be a challenging task, even though 
computational performance of computers is increasing. 
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Volume rendering of medical data sets without quality reduction is a challenging task 
due to the increasing amount of acquired data in, for example, computed tomography 
(CT) and magneto resonance (MR) applications. Interactions are needed in order to let 
the clinician navigate through the data set in order to get the optimal field of view. Fur- 
5 thermore, the resulting sequence of images provides additional three-dimensional in- 
formation to the observer that he cannot perceive fi-om still images. 

In order to allow for fast navigation, medical work stations typically provide a "pre- 
view" mode in which the image resolution is reduced in order to aUow for interactive 

10 updates during interaction. When the user interaction stops, the image is re-rendered at 
full quality, which may take some time (typically in the order of seconds). In state-of- 
the-art work stations, the preview mode is implemented by uniformly rendering the im- 
age at a lower resolution. This method does not take into account that some portions of 
the image are more relevant to the observer than others.. In general, the quality may be 

15 too low in order to observe a certain object of interest, since small details may appear 
blurred or distorted, so that the clinician has to stop with his interaction. Therefore, for 
example, it is not possible to observe the object of interest at motion. On the other hand, 
a high resolution view mode or fuU-scan mode of the whole image demands too much 
computational time for providing a fast visualization during user interaction. 

20 

It is an object of the present invention to provide for an improved visualization of a 
three-dimensional data set. 

According to an exemplary embodiment of the present invention as set forth in claim. 1, 
25 fhe_ab-oye.Qbject may be solved by a method of interactively visualizing a three-dimen- 
sional data set of an_object of interest, wherein the method allo ws for an interactive irb 
putmd-comprrses the step of varying a rendering; meth ad ia-a n i m age during thainter- 
ncti\/^5~input. The varioliQn^ cauGSC a non-umfQrmquaiitjf of tlie 
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Advantageously, according to this exemplary embodiment of the present invention, dif- 
ferent areas in the image may be rendered with different rendering methods, resulting in 
different appearances, qualities or resolutions of the different areas. Therefore, during a 
user interaction, regions of high interest, indicated e.g. by user interaction, may be ren- 
5 dered with a first rendering method, resulting in high image quality in the regions of 
high interest, and regions of lower interest may be rendered with a second rendering 
method, resulting in lower image quality in the regions of lower interest. A region of 
high interest may e.g. also be indicated by a stopping of the user interaction. For exam- 
ple, when the user scrolls through a data set, e.g. by activating the mouse wheel, and 
10 stops at a certain region, it may be assumed that the user is interested in this region and 
thus, that there is a region of high interest. 

According to another exemplary embodiment of the present invention as set forth in 
claim 2, the image is rendered with the varying renderiag method in a pre-scan mode, if 
15 there is an interactive input. On the other hand, if there is no interactive input, the 

image is re-rendered with a constant rendering method in a full-scan mode, resulting in 
a maximum quality or resolution of the whole image. 

Advantageously, according to this exemplary embodiment of the present invention, a 
20 variation of the rendering method, such as, e.g., a variation of a sampling rate, is only 
performed during an interactive input, such as a user interaction. If there is no interac- 
tive input, the method switches to a full-scan mode and the image is rendered with a full 
rendering. This may provide for a fast visualization of an object of interest inside the 
three-dimensional data set 

25 

According to another exemplary embodiment of the present invention as set forth in 
claim 3, the variation of the rendering method comprises a variation of a sampling rate 
in the image dming the interactive input. The variation of the sampling rate causes a 
non-uniform resolution of the image. 



30 
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Advantageously, according to this exemplary embodiment of the present invention, dif- 
ferent areas in the image may be sampled at different sampling rates, resulting in differ- 
ent resolutions of the different areas. Therefore, during a user interaction, regions of 
high interest, indicated e,g, by user interaction, may be sampled at a high rate and re- 
5 gions of lower interest may be sampled at a lower rate, A region of high interest may 
e,g. also be indicated by a stopping of the user interaction. For example, when the user 
scrolls through a data set, e.g. by activating the mouse wheel, and stops at a certain re- 
gion, it may be assumed that the user is interested in this region and thus, that there is a 
region of high interest. 

10 

According to another exemplary embodiment of the present invention as set forth in 
claim 4, the variation of the rendering method is performed on the basis of information 
acquired during rendering and the information comprises information concerning the 
interactive input. 

15 

Advantageously, this may allow for interactively changing the rendering method, such 
as the sampling rate, of a particular area of the image, resulting in, for example, a high 
resolution of that particular area. On the other hand, the resolution or the quality of the 
rendering method of another area may be interactively reduced, resulting in a lower 
20 resolution of that other area, which may increase the rendering speed. 

According to another exemplary embodiment of the present invention as set forth in 
claims-5 and-6, the sampling rate comprises a first sampling rate and a second sampling 
rate, wherein a focus area defines a first area in the image. The first area is sampled 
25 with the first sampling rate. Furthermore, a secondarea in the image is sampled with 
the second sampling rate and a relative position of the focus area is. movable with 
respect to the^ima^e by one of a user and an automatism based on information acquired 
durin^rxendeiiaHr 
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the image which may lead to higher quality or resolution of the other spot in the image. 
Advantageously, according to an aspect of this exemplary embodiment of the present 
invention, the shift of the focus area may be performed automatically based on informa- 
tion acquired during rendering, such as information about image contents or motion 
between subsequent frames. 



According to another exemplary embodiment of the present invention as set forth in 
claim 7, the information comprises information selected from the group consisting of 
estimation of a complexity of the data set, unavailabihty of hardware resources, and 
update speed required from a user. 



an 
an 



an 
len- 



Advantageously, according to this exemplary embodiment of the present invention, 
increasing complexity of the data set may lead to an increase of the quaKfy of the 
dering method (such as the sampling rate) withm the focus area which may provide for 
a high resolution or quaUty within the focus area for detaUed inspection. Furthermore, 
according to this exemplary embodiment of the present invention, an increase in update 
speed required from a user may lead to a reduction of the overall quality of the render- 
ing method (e.g. the samplmg rate ) in the image. This can, for example, be achieved by 
reducing the size of high-quality areas in the hnage and increasing the size of low-qual- 
ity areas. 



According to another exemplary embodiment of the present invention as set forth m 
claims 8 and 9, the rendering includes ray casting, which may involve the computation 
or determination of depth values and light reflection angles. According to an aspect of 
the present invention, the variation of the sampUng rate is performed along a ray 
applied in the ray casting. 

According to these exemplary embodiments of the present invention, a ray casting may 
be used to generate the image with varying resolution along a ray. 
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According to another exemplary embodiment of the present invention as set forth in 
claim 10, a data processing device is provided comprising a memory for storing a three- 
dimensional data set of an object of interest and a data processor for performing an in- 
teractive visualization of the tiiree-dimensional data set, wherein the interactive visuali- 
zation allows for an interactive input, and wherein the data processor is adapted for per- 
forming the following operation: loading the tiiree-dimensional data set, and varying a 
rendering metiiod in an image during tiie interactive input The variation of the render- 
ing metiiod causes a non-uniform quaHty of tiie image and tiie image is determined on 
the basis of the three-dimensional data set 

Advantageously, tiiis may allow for a fast visualization of an object of interest in a 
three-dimensional data set 

Anotiier advantageous embodiment of the data processing device is set forth in claim 
15 11. 

The present invention also relates to scanner systems comprising a memory for storing 
a three-dimensional data set of an object of interest and a data processor for performing 
an interactive visuaHzation of tiie tiiree-dimensional data set wherein flie interactive 
20 visualization allows for an interactive input during which a rendering method in an im- 
age is varied. According to an aspect of tiie present invention, tiie scanner system is one 
of a CT scanner system and a MR scanner system. The scanner systems according to 
the present invention are set forth in claims^ 12 and 13. 

25 Advantageously; tiiis may allow for.anJmproved rendering performance of an object of 
interest in a^tinee-dimensional data set acquired by a CT scaunec^ystem or aMR scan- 
nearsystem^ 
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grams, according to an exemplary embodiment of the present invention, are set forth in 
claim 14. These computer programs may be preferably loaded into working memories 
of data processors. The data processors are thus equipped to cany out exemplary em- 
bodiments of the methods of the present invention. The computer programs may be 
5 stored on a computer readable medium, such as a CD-ROM. The computer programs 
may also be presented over a network such as the WorldWideWeb, and may be 
downloaded into the working memory of a data processor from such networks. The 
computer program according to this exemplary embodiment of the present invention 
may be written in any suitable programming language, such as C++. 

10 

It may be seen as the gist of an exemplary embodiment of the present invention that a 
three-dimensional data set of an object of interest is interactively visuedized with a 
varyiag rendering method in an image during an interactive input. According to an ex- 
emplary embodiment of the present invention, a first area of the image is sampled with 

15 a high sampling rate and a second area of the image is sampled with a lower sampling 
rate, wherein the position of the first area may be interactively moved by a user by e.g. 
an appropriate user interaction or stopping of an user interaction. Advantageously, this 
may allow for a fall resolution of an area of the image the user is particularly interested 
in, whereas areas of the image the user is not particularly interested in may be rendered 

20 at a low rate, resulting in a low resolution. This may lead to a reduction of computa- 
tional cost while still providing for sufficient image quality of a part of the image which 
is of interest for the user. 

These and other aspects of the present invention will become apparent from and eluci- 
25 dated with reference to the embodiments described hereinafter. 

Exemplary embodiments of the present invention wiU be described in the following, 
with reference to the following drawings: 

30 Fig. 1 shows a simplified schematic representation of an embodiment of a computed 
tomography (CT) scanner according to the present invention. 
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Fig. 2 shows a simplified schematic representation of an embodiment of a magneto- 
resonance (MR) scaimer according to the present invention. 

5 Fig. 3 shows a full-quality image rendered at a maximum rate (left), an image rendered 
at a uniform sub-sampling rate (middle) and a focused preview of an image rendered at 
varying rates according to an exemplary embodiment of the present invention (right). 

Fig. 4 shows a flow-chart of an exemplary embodiment of a method of interactively 
10 visualizing a three-dimensional data set of an object of interest according to the present 
invention. 

Fig. 5 shows an exemplary embodiment of the present invention of an image processing 
device according to the present invention, for executing an exemplary embodiment of a 
1 5 method in accordance with the present invention. 

Fig. 1 shows an exemplary embodiment of the present invention of a CT (computed 
tomography) scanner system according to the present invention. With reference to this 
exemplary embodiment, the present iavention will be described for the application in 
20 medical imaging. However, it should be noted that the present invention is not limited 
to the application in the field of medical imaging, but may be used in applications such 
as baggage inspection to detect hazardous materials, such as explosives, in items of 
baggage or other industrial applications, such as material testing. 

25 The scanner depicted in Fig, 1 is a cone-beam CT scanner. The CTscann^ depicted Jn 
Fig. 1 comprises a gantry 1, whichis.rotatable_ aronnd^a rotational axis 2. The. gantry, is 
driven by means of a motor 3. Reference numeral 4 designates a source of radiation 
such as: im x-ray source/which, according to an aspect of die present imrention^ emitz a 
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Reference numeral 5 designates an aperture system which forms a radiation beam emdt- 
ted from the radiation source to a cone-shaped radiation beam 6. 

The cone-beam 6 is directed such that it penetrates an object of interest 7 arranged in 
5 the centre of the gantry 1, i.e. in an exanrination region of the CT scaoner, and impinges 
onto the detector 8. As may be taken from Fig. 1, the detector 8 is arranged on the gan- 
try 1 opposite the source of radiation 4, such that the surface of the detector 8 is covered 
by the cone-beam 6. The detector 8 depicted in Fig. 1 comprises a plurality of detector 
elements. 

10 

During a scan of the object of interest 7, the source of radiation 4, the aperture system 5 
and detector 8 are rotated along the gantry 1 in the direction indicated by arrow 16, For 
rotation of the gantry 1 with the source of radiation 4, the aperture system 5 and the de- 
tector 8, the motor 3 is connected to a motor control unit 17, which is connected to a 
1 5 calculation unit 18. 

In Fig. 1, the object of interest is disposed on a conveyor belt 17. During the scan of the 
object of interest 7, while the gantry 1 rotates around the patient 7, the conveyor belt 19 
displaces the object of interest 7 along a direction parallel to the rotational axis 2 of the 

20 gantry 1. By this, the object of interest 7 is scanned along a helical scan path. The con- 
veyor belt 19 may also be stopped during the scans. Instead of providing a conveyor 
belt 19, for example, in medical applications, where the object of interest 7 is a patient, 
a movable table is used. However, it should be noted that in all of the described cases it 
is also possible to perform a circular scan, where there is no displacement in a direction 

25 parallel to the rotational axis 2, but only the rotation of the gantry 1 around the rota- 
tional axis 2. 

The detector 8 is connected to the calculation unit 18. The calculation unit 18 receives 
the detection result, i.e. the read-outs from the detector element of the detector 8, and 
30 determines a scanning result on the basis of thie read-outs. The detector elements of the 
detector 8 may be adapted to measure the attenuation caused to the cone-beam 6 by the 
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object of interest. Furthermore, the calculation unit 18 communicates with the motor 
control unit 17 in order to coordinate the movement of the gantry 1 with motor 3 and 20 
or with the conveyor belt 19. 

5 The calculation unit 18 may be adapted for reconstructing an image from read-outs of 
the detector 8. The image generated by the calculation unit 18 may be output to a dis- 
play (not shown in Fig, 1) via an interface 22. 

The calculation unit which may be realized by a data processor integrated into a data 
10 processing device comprising a memory for storing a three-dimensional data set of an 
object of interest may also be adapted to perform an interactive visualization of the 
three-dimensional data set, wherein the interactive visualization allows for an interac- 
tive input, for example by a user. The data processor according to an aspect of the pre- 
sent invention may be adapted for loading the three-dimensional data set and for 
15 varying a sampling rate in a projection image during the interactive input. The variation 
of the sampling rate causes a non-uniform resolution of the projection image, meaning 
that a region or regions of high resolution of the projection image are generated and that 
a region or regions of low resolution are generated. It should be understood that the pro- 
jection image is acquired on the basis of the three-dimensional data set. 

20 

Furthermore, the data processor may be adapted for performing an interactive visualiza- 
tion, of the three-dimensional data set, wherein, if there is an interactive input, the three- 
dimensional data set is rendered at the varying sampling rate in a pre-scan mode and 
wherein, if there is no interactive input,. the.three-dimensionaLdata set is re-rendered at 
25 a full sampling rate in a full-scan mode, resulting in a ma^dmumTesolution of the whole 
projection image^ The variatioiLof the_sa.mp1ing rate is hereby perfbrmed_on_.the basis of 
information acquired during renderings whei^ia-the in f o rmation-comprises information 
about thaint^^raGtis^e input. 
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Fig. 2 shows a simplified schematic representation of an embodiment of a MR scanner 
system according to the present invention. The MR scajtmer system comprises coils 210 
which are arranged along an axis 218 and surround an examination space 217, in which 
5 a patient 215 which has to be examined is positioned. Advantageously, the patient lies 
on a movable table or conveyor belt 216, which is disposed at the lower part of the ex- 
amination space 217. The system of coils 210 surrounding the examination space 217 
comprises an HF-coil 219, an actively shielded arrangement of gradient coils compris- 
ing an inner coil 213 and an actively shielded coil or shield 212 and a cryostat 21 1, in 
10 which the coils are arranged in order to be cooled down during generation of the mag- 
netic field. The arrangement of gradient coils 213, 212 may be connected to a gradient 
amplifier 220. 

Furthermore, the MR scanner system may comprise, according to the CT scanner sys- 
15 tem depicted in Fig. 1, a motor control unit with respective motors, for example for 

moving the conveyor belt 216, and a calculation unit (not shown in Fig. 2). Such a MR 
scanner system is described in DE 102 02 986 Al, which is hereby incorporated by ref- 
erence. 

20 Fig. 3 shows an example of a full-quality image of 400 pixels 31 and a uniformly sub- 
sampled image 32 resulting from the same data set but sampled with a lower sampling 
rate than the image 31. This uniform rendering of the image 32 at a lower resolution in 
a preview mode is a technique applied in work stations in order to provide a fast image 
visualization. Unfortunately, this method does not take into account that some portions 

25 of the image are more relevant to the observer than others. As may be seen from image 
32, the quality in the centre of the image is too low to observe that the schematic phase 
depicted in the image is smiling. Therefore, in order to get a more detailed view of the 
image centre, the user has, for example, to stop his interaction and switch to the full- 
quality image mode as depicted in image 31. 



30 
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Image 33 shows a non-uniformly sub-sampled image of 104 pixels (the image 32 com- 
prises 100 pixels). The centre of the image 33 is rendered at full resolution and the 
resolution decreases towards the image borders. The focus area, according to an exem- 
plary embodiment of the present invention, may either be fixed in the image centre or 
5 variable, for example movable by the user. In both cases, the user has the possibility to 
move his object of interest into the focus area in a very intuitive way and then to ob- 
serve it interactively at full quality. 

Therefore, the invention combines interactive speed (guaranteed response time) with 
10 optimal image quality by reducing the sampling rate and therefore the image quality in 
regions which are of low interest for the user. At the same computational complexity, 
the perceived image quality is better than with conventional undersampling, which is 
depicted in image 32. 

15 In a simple and intuitive way, the user can, according to an exemplary embodiment of 
the present invention, move the "interesting" region into the focus area or vice versa. 
Thus, a full-quality visualization at an interactive frame rate may be achieved, which is 
not possible by conventional sub-sampling. 

20 In the following, an exemplary implementation of the present invention is described. 
The output image of x times y pixels is divided into three areas: an inner, area or first 
area, a peripheral area or second area and an outer area or third area. 

The inner, area covers_the-,central rectangle of approximately l/3x • l/3y pixels and 
25 will be rendered at fuU resolution. 

The peripheraLarea.or_seaoiiiama,GOYers-thejGentnd rectangle of approidmBtely 2/3x ^ 
2/3y pt^iek excluding the ioner area: It willhe rendered athalfjic^olutLonin hnth 



-13- 



PHDE040074 EPP 



The outer area covers the rest of the image and will be rendered at a quarter of the 
resolution resulting in 1/16 of the samples per area unit compared to full-quality ren- 
dering. 

5 It should be noted that, although this exemplary embodiment of the present invention 
makes use of three areas which are rendered at three different sampling rates, the above 
method may also be used for two different areas rendered at two sampling rates, or for 
any other number of different image areas which will be rendered at different sampling 
rates, 

10 

In the above described case of three different sampling rates, the total number of pixel 
values to be calculated exactly is approximately 

l/3x . l/3y + i4(2/3x • 2/3y-l/3x • l/3y) + 1/16 (xy - 2/3x • 2/3y) = ll/48xy, 

15 

which is slightiy less than l/4xy for uniform half-resolution sampling, so that the com- 
putational complexity for creating such a preview is also similar. However, the central 
part is rendered at full quality, and by the usual navigation tools the user may move the 
most interesting part into the viewport centre. This way, the user may then observe that 
20 part animated at full resolution while still having an impression of the surrounding ar- 
eas, which are rendered at reduced quality. 

The sizes and sub-sampling rates of the inner, peripheral and outer areas as described 
above as well as the total number of different zones or areas may be varied. 

25 

The variation of these parameters may be performed dynamically based on 
a) the complexity of the data set, 
30 b) unavailability of hardware resources, and 
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c) the type of interaction. For example, during fast interactions, the "high quality" 
area may be reduced to achieve faster image updates, while during slow interac- 
tions the size of the 'Tiigh quality" area or areas is increased to improve the gen- 
eral image quality, 

5 

Furthermore, the focus area may not be fixed in the centre of the image, but be placed 
a) by the user, or 

10 b) automatically based on the image contents, such that, for example, the focus 
area is moved to small stractures which need a high resolution, or 

c) automatically based on motion between subsequent frames (full resolution 
where little motion, low resolution where much motion), 

15 

Furthermore, the focus criteria may not just determine the sample rate in the image do- 
main, but any other parameter of the rendering algorithm that allows a speed-quaHty 
trade-off. One example is to vary the sampling rate along a ray if ray casting is used. 

20 Furthermore, it should be understood that, according to an aspect of the present inven- 
tion, it may not be the sampling rate which is varied, but, for example, an arithmetic 
accuracy used for the rendering. For example, if for the calculation of image colour valt . 
ues single-precision floating point numbers (e.g. by using the 32-bit format according to 
the IEEE standard) are used instead of double-precision representations (e.g. according 

25 to the IEEE 64-bit format), the computational cost may be reduced at the expense of a 
lower accuracy. As another example^, some rendering methods require the calculation of 
complex_arifhmeticaLfmiGtioiis such_as e"", ln(x), or sqrt(7r). Such fanctions can_be re- 
placed by 3iD3ple linear^onpolvnomial apprniAriinions. a^ainxic. aie.e^B>=rrs>- af r^nih- 
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Furthermore, the focus criteria may be combined with an adaptive sampling technique 
which, for example, involves the computation or determination of depth values and 
light reflection angles and a variation of the sampling frequency in the projection image 
5 on the basis of at least one of a depth value, surface normal, viewing direction, and light 
vector. Therefore, by combining an exemplary method according to the present inven- 
tion with an adaptive sampling technique are fast rendering with high resolution in the 
focus area may be achieved. 

10 Fig, 4 shows a flow-chart of an exemplary embodiment of a method of interactively 
visualizing a three-dimensional data set of an object of interest according to the present 
invention. The method starts at step SI, after which a three-dimensional data set of an 
object of interest is acquired in step S2, for example by means of a polychromatic ^ 
source of electro-magnetic radiation generating a polychromatic beam and by means of 

15 a radiation detector detecting the polychromatic beam. Then, in step S3 it is determined 
whether there is an interactive input or whether there is no interactive input. In case, 
there is an interactive input, rendering information is acquired in step S5. This 
rendering information may comprise information about the interactive input, such as 
movement of the focus area, or an update speed required by the user. Furthermore, the 

20 rendering information may comprise information about an availability of hardware 

resources or a complexity of the data set After acquisition of the rendering information, 
the projection image is rendered at a varying sampling rate on the basis of the acquired 
rendering information in step S6, such that, for example, the image is rendered at full 
resolution in an irmer area defined by the focal area adjusted by the user, whereas the 

25 image is rendered at a lower resolution in areas outside the inner area. 

After that, in step S7 the method jumps back to step S3 where it is determined whether 
there is an interactive input or no. In case it is determined in step S3, that there is no 
interactive input, the method jumps to step S9, in which it is determined, whether a re- 
30 rendering has already been performed. In case a re-rendering has already been per- 
formed, the method waits for a further interactive input in step SIO after which it jumps 
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to step S5 for the acquisition of rendering information. In case it is determined in step 
S9, that no re-rendering has already been performed, the projection image is re- 
rendered at a full sampling rate in step S4 after which it jumps to step SIO in order to 
wait for another interactive input 

5 

Thus, during an interactive input, rendering information is acquired and a rendering of 
the projection at a varying sampling rate on the basis of the rendering information is 
performed continuously, e.g. in form of a closed loop. If there is no interactive input 
any more, the closed loop is left and the projection image is re-rendered at full image 
10 quality, if no re-rendering of the image has already been performed. If, however, it is 
determined in step S9, that a re-rendering of the image has already been performed, the 
method waits for another interactive input in step SIO, after which it jumps directiy to 
step S5 for the acquisition of rendering infomaation. 

15 Fig. 5 depicts an exemplary embodiment of an image processing device according to 
the present invention, for executing an exemplary embodiment of a method in 
accordance with the present invention. The image processing device depicted in Fig, 5 
comprises a central processing unit (CPU) or image processor 151 connected to a 
memory 152 for storing an image depicting an object of interest, such as a patient. The 

20 image processor 151 may be connected to a plurality of input/output network or 
diagnosis devices, such as a MR device or a CT device. The image processor is 
furthermore connected to a display device 154, for example a computer monitor, for 
displaying information or an image computed or adapted in the image processor 151. 
An_operator may interact withuthe image processor 151 via a keyboard_155 and/or other 

25 output devices, which are not depicted in Eig*_5. 

Furthermore, via the bus system 153 it is also possihle_to connect the image processing 
and Gontrnl procescror 151 to, for eiisin2ple.-a raatioji.mordtorwhichimQnitors" moliou 
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It should be noted diat, although the embodiments of the invention described widi respect 
to die drawings vary die sampling rate in order to provide for an improved quality of re- 
gions of high interest, the mediod is not limited to variation of die sampling rate but may 
also, e.g., vary a rendering method, such as. e.g., varying an aridimetic accuracy used for 
the rendering, for example by replacing complex arithmetical fimctions such as e", hi(x). or 
sqrt(x) by simple linear or polynomial approximations. 
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CLAIMS 



1. A method of interactively visualizing a three-dimensional data set of an object of 
interest, wherein the method allows for an interactive input, the method con^iising the 
step of: 

varying a rendering method in an image during the interactive input; 
wherein the variation of the rendering method causes a non-uniform quaUty of the im 
age; and 

wherein the image is determined on the basis of the three-dimensional data set. 

2. The method according to claim 1, 

wherein, if there is an interactive input, the image is rendered with the varying 
rendering method in a pre-scan mode; and 

wherein, if there is no interactive input, the image is re-rendered with a constant 
rendering method in a fuU-scan mode, resulting in a maximum quality of the whole im- 
age. 

3. The method according to claim 2, 

wherein the variation of the rendering method comprises a variation of a sampHng rate 
in the image during the interactive input; and 

wherein the variation of the sampHng rate causes a non-uniform resolution of the 

image. 

4. The method according to claim 1, 

wherein the variation of the rendering method is performed on the basis of in- 
formation acquired during rendering; and 

wherein the information comprises information concerning the interactive input. 
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5. The method according to daim 3, 

wherem the sampling rate comprises a first sampling rate and a second sampling 

rate; 



wherein the first area is sampled with the first sampling rat^ and 

wherein a second area in the image is sampled with the second sampling rate. 

6. The method according to d^m 5, 

wherein a relative position of the focus area is movable with respect to the 
image by one of a user and an automatism based on information acquired during 
rendering. 

7. The method according to claim 4, 

wherein the information comprises information selected from the group con- 
sisting of an estimation of a complexity of the data set, an availability of hardware r< 
sources, and an update speed required from a user. 

8. The method according to daim 1, 

wherein the rendering indudes a ray casting. 

9. The method according to claim 8, 

wherein the variation of the sampMng rate is performed along a ray appUed i 

the ray casting. 

10. Adata processing. d£2ice,^comprisingr 



wherein a focus area defines a first area in the image; 
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loading the three-dimensional data set; 

varying a rendering method in an image during the interactive input; 
wherein the variation of the rendering method causes a non-uniform resolution of the 
image; and 

5 wherein the image is determined on the basis of the three-dimensional data set. 

11. Data processing device according to claim 10, 
wherein, if there is an interactive input, the three-dimensional data set is ren- 
dered with the varying rendering method in a pre-scan mode; and 

wherein, if there is no interactive input, the three-dimensional data set is re-ren- 
dered with a full rendering method in a full-scan mode, resulting in a maximum resolu- 
tion of the whole image; and 

wherein the variation of the rendering method is performed on the basis of in- 
formation acquired during rendering; and 

wherein the information comprises information concerning the interactive input 

12. A scanner system, comprising: 
a memory for storing a three-dimensional data set of an object of interest; 
a data processor for performing an interactive visualization of the three-dimensional 

20 data set, wherein the interactive visualization allows for an interactive input, wherein the 
data processor is adapted for performing the following operation: 
loading the three-dimensional data set; 

varying a rendering method in an image durmg the interactive mput; 
wherein the variation of the rendering method causes a non-uniform quality of the im- 
25 age; and 

wherein the image is determined on the basis of the three-dimensional data set. 

13. A scanner system according to claim 12, 

wherein the scanner system is one of a CT scanner system and a MR scanner sys- 
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tern. 

14. A computer program product for performing an interactive visualization of a three- 
dimensional data set of an object of interest, wherein the interactive visualization allows for 
5 an interactive input, wherein the computer program product causes a data processor to 
perform the following operation when the computer program is executed on the data proc- 
essor: 

loading the three-dimensional data set; 

varying a rendering method in an image during the interactive input; 
0 wherein the variation of the rendering method causes a non-uniform quality of the im- 
age; and 

wherein the image is determined on the basis of the three-dimensional data set 
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ABSTRACT 
Image visualization 

Medical imaging modalities generate increasingly more and very large three-dimen- 
sional data sets. According to an exemplary embodiment of the present invention, a 
5 three-dimensional data set of an object of interest is interactively visualized with a 
varying sampling rate in an image. Advantageously, a focus area may be moved by a 
user interactively during rendering, wherein the sampling rate of a particular part of the 
image is defined by its relative position to the focus area. Advantageously, this may 
allow for an improvement of an overall rendering performance. 

10 
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